Name | Version | Summary | date |
---|---|---|---|
rs-bpe | 0.1.0 | A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust | 2025-03-19 05:58:24 |
kitoken | 0.10.1 | Fast and versatile tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization | 2024-12-20 03:07:14 |
hour | day | week | total |
---|---|---|---|
60 | 1335 | 8021 | 295380 |